Method and apparatus for displaying information and program and medium used therefor

ABSTRACT

A content processing routine divides a thumbnail-area according to data size and generates the same number of pixels values as the number of divided thumbnail-areas. The content processing routine sets the generated pixel values to the divided thumbnail-areas and controls the display processing so that the thumbnails set with the pixel values are displayed.

BACKGROUND OF THE INVENTION

The present invention relates to a method and an apparatus fordisplaying information, and a program and a program storage medium usedtherefore, and particularly to a method and an apparatus for displayingthumbnails corresponding to data, and a program and a program storagemedium used therefore.

Technologies are currently available with personal computers for examplein which a thumbnail which corresponds to still picture or movingpicture data is displayed for a personal computer user to select thesedata by means of the thumbnail to manipulate the selected data.

However, a problem with the prior art is that the personal computers inwhich a thumbnail is displayed for data manipulation can manipulate onlydata including images, not data including no image.

SUMMARY OF THE INVENTION

It is therefore an object of the present invention to provide aninformation processing apparatus and method and a program storage mediumwhich are capable of displaying a thumbnail for data including no imageto manipulate both of data including images and data including no imagetogether.

To achieve the above object, according to a first aspect of the presentinvention, there is provided a displaying method of displaying imageinformation corresponding to a desired data file in a specific displayarea, including the steps of: dividing the specific display area into afirst number of areas; and displaying each of the divided areas in amode corresponding to contents of the desired data file.

According to a second aspect of the present invention, there is provideda displaying apparatus for displaying image information corresponding toa desired data file in a specific display area, including: means fordividing the specific display area into a first number of areas; andmeans for displaying each of the divided areas in a mode correspondingto contents of the desired data file.

According to a third aspect of the present invention, there is provideda medium for storing a program for displaying image informationcorresponding to a desired data file in a specific display area, theprogram including the steps of: dividing the specific display area intoa first number of areas; and displaying each of the divided areas in amode corresponding to contents of the desired data file.

According to a fourth aspect of the present invention, there is provideda computer readable program for displaying image informationcorresponding to a desired data file in a specific display area,including the steps of: dividing the specific display area into a firstnumber of areas; and displaying each of the divided areas in a modecorresponding to contents of the desired data file.

In the above-described method, apparatus, medium and program of thepresent invention, the mode corresponding to contents of the desireddata file is preferably determined by changing lightness or saturationof one or a plurality of pixels in each of the divided areas on thebasis of the contents of the desired data file; and the lightness orsaturation of one or a plurality of pixels in each of the divided areasis preferably changed by taking unit data quantities of the data file asdata values of red, green and blue dots of the one or a plurality ofpixels in each of the divided areas. Also, the first number ispreferably a number changed depending on the size of the data file andthe first number is preferably a number changed in proportion to thesize of the data file; and the desired data file is preferably an audiofile, or a text file.

Further, in the above-described method, apparatus, medium and program ofthe present invention, boundaries among the divided areas are preferablyblurred after the lightness or saturation of one or a plurality ofpixels in each of the divided areas is changed; and all or part of thecontents of the text file is preferably displayed in the form of text insuch a manner as to be overlapped to the image information.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a perspective view illustrating an external view of anote-size personal computer practiced as one embodiment of theinvention;

FIG. 2 is a top view of a main body;

FIG. 3 is an enlarged view of a jog dial;

FIG. 4 is a side view of the personal computer;

FIG. 5 is a diagram illustrating one embodiment of the personalcomputer;

FIG. 6 is a diagram illustrating the configuration of a display programand a reading program;

FIG. 7 is a diagram illustrating a screen displayed on an LCD;

FIG. 8 is a diagram illustrating a screen displayed on the LCD;

FIG. 9 is a diagram illustrating a screen displayed on the LCD;

FIG. 10 is a diagram illustrating a thumbnail corresponding to voicedata;

FIG. 11 is a diagram illustrating a procedure of generating a thumbnailfor displaying an image corresponding to voice data;

FIG. 12 is a diagram illustrating thumbnail examples for displayingimages corresponding to voice data;

FIG. 13 is a diagram illustrating a thumbnail example for displaying animage corresponding to text data;

FIG. 14 is a diagram illustrating a related-art thumbnail arrangement;

FIG. 15 is a diagram illustrating a line view;

FIG. 16 is a diagram illustrating axes;

FIGS. 17A to 17F are diagrams illustrating a line view;

FIG. 18 is a diagram illustrating a loop view;

FIG. 19 is a diagram illustrating another loop view;

FIG. 20 is a diagram illustrating axes;

FIG. 21 is a diagram illustrating a spiral view;

FIGS. 22A to 22B are diagrams illustrating another spiral view;

FIG. 23 is a diagram illustrating an axis;

FIG. 24 is a diagram illustrating a square view;

FIG. 25 is a diagram illustrating another square view;

FIG. 26 is a diagram illustrating the movement of an icon;

FIGS. 27A to 27C are diagrams illustrating the movement of the icon;

FIG. 28 is a diagram illustrating after-image processing;

FIG. 29 is a diagram illustrating after-image processing;

FIG. 30 is a diagram illustrating a status transition;

FIG. 31 is a diagram illustrating a transition function;

FIG. 32 is a diagram illustrating a status transition;

FIG. 33 is a diagram illustrating a status transition;

FIG. 34 is a diagram illustrating processing for changing displaypositions of thumbnails;

FIG. 35 is a diagram illustrating one example of changing displaypositions of thumbnails;

FIG. 36 is a diagram illustrating another example of changing displaypositions of thumbnails;

FIG. 37 is a diagram illustrating the selection of a thumbnail;

FIG. 38 is a diagram illustrating the selection of the thumbnail;

FIG. 39 is a diagram illustrating an enlarged display;

FIG. 40 is a diagram illustrating the selection of a thumbnail;

FIG. 41 is a diagram illustrating the selection of the thumbnail;

FIG. 42 is a diagram illustrating an enlarged display;

FIG. 43 is a diagram illustrating the selection of a thumbnail;

FIG. 44 is a diagram illustrating the selection of the thumbnail;

FIG. 45 is a diagram illustrating an enlarged display;

FIG. 46 is a diagram illustrating the selection of a thumbnail;

FIG. 47 is a diagram illustrating the selection of the thumbnail;

FIG. 48 is a diagram illustrating an enlarged display;

FIG. 49 is a diagram illustrating the degree of importance;

FIG. 50 is a diagram illustrating one example of processingcorresponding to the degree of importance;

FIG. 51 is a diagram illustrating a display of a frame;

FIG. 52 is a diagram illustrating one example of variation in lightnessor saturation of the frame in correspondence with elapsed time;

FIG. 53 is a diagram illustrating one example of variation in hue of theframe in correspondence with elapsed time;

FIG. 54 is a diagram illustrating the processing of displaying anadditional attribute display;

FIG. 55 is a diagram illustrating one example of displaying theadditional attribute display;

FIG. 56 is a diagram illustrating one example of displaying thumbnailsand others in all or part of the screen of the LCD;

FIG. 57 is a diagram illustrating one example of displaying thumbnailsand others all over the screen of the LCD;

FIG. 58 is a diagram illustrating an icon;

FIG. 59 is a diagram illustrating an icon;

FIG. 60 is a flowchart describing the processing of reading content;

FIG. 61 is a flowchart describing the processing of displaying voicedata;

FIG. 62 is a flowchart describing the processing of displaying a lineview;

FIG. 63 is a flowchart describing the processing of displaying a loopview;

FIG. 64 is a flowchart describing the processing of displaying a spiralview;

FIG. 65 is a flowchart describing the processing of moving an icon;

FIG. 66 is a flowchart describing the processing of displaying anafter-image;

FIG. 67 is a flowchart describing the processing of status transition;

FIG. 68 is a flowchart describing the processing of enlarged display;

FIG. 69 is a flowchart describing the processing of displaying a frame;

FIG. 70 is a flowchart describing the processing of displayingattributes; and

FIG. 71 is a flowchart describing the processing of selecting betweendisplay modes.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIGS. 1 through 4 show external views of a note-size personal computerpracticed as one embodiment of the present invention. A personalcomputer 1 is basically composed of a main body 2 and a display section3 pivotally attached to the main body 2. FIG. 1 is an externalperspective view of the personal computer 1 with the display section 3open relative to the main body 2. FIG. 2 is a top view of the main body2. FIG. 3 is an enlarged view of a jog dial 4 to be described laterarranged on the main body 2. FIG. 4 is a side view of the jog dial 4arranged on the main body 2.

The main body 2 is arranged, on its top side, with a keyboard 5 which isoperated to enter various characters and symbols, a touch pad 6, whichis a pointing device for use in moving a pointer (or mouse cursor)displayed on an LCD 7, and a power switch 8. On one side of the mainbody 2, the jog dial 4, a slot 9, an IEEE 1394 port 101, a memory stickslot 115, etc. are arranged. It is practical to arrange a stick-typepointing device instead of the touch pad 6.

On the front surface of the display section 3, the LCD (Liquid CrystalDisplay) 7 for displaying images is arranged. In the upper right cornerof the display section 3, such LED lights as a power light PL, a batterylight BL, and, as required, a message light (not shown) are arranged. Amicrophone 66 is arranged at the upper edge of the display 3.

The power light PL, the battery light BL, and the message light ML maybe arranged at the lower edge of the display 3.

The jog dial 4 is mounted so that it comes between key A and key Barranged on the right side of the keyboard 5 shown in FIG. 2 of the mainbody 2, the top surface of the jog dial 4 being approximately flush withthe top surfaces of these keys. The jog dial 4 is operated in thedirection indicated by arrow “a” shown in FIG. 3 to execute apredetermined process (for example, a display screen scrolling process)and in the direction indicated by arrow “b” to execute anotherpredetermined process (for example, an icon selection enter process).

The jog dial 4 may be arranged on the left side of the main body 2. Thejog dial 4 may also be arranged on the left or right face of the display3 with the LCD 7 arranged or vertically between G key and H Key of thekeyboard 5 (so that the jog dial 4 is rotatable in the directionsparallel to Y key and B key).

The jog dial 4 may be arranged in a central portion of the front face ofthe main body 2 so that the user can operate the jog dial 4 with thethumb while operating the touch pad with the index finger. The jog dial4 may also be arranged horizontally along the upper rim or the lower rimof the touch pad 6 or vertically between the left and right buttons ofthe touch pad 6. The jog dial 4 may also be arranged not vertically orhorizontally but diagonally at which angle is easy for the operator torotate the jog dial 4. The jog dial 4 may be arranged at the side of themouse, a pointing device, at which the user can operate the jog dial 4with the thumb. For the jog dial 4, a rotary electronic device with apush switch disclosed in Japanese Patent Laid-open No. Hei 8-203387 forexample.

The slot 9 accommodates a PC card, which is an extension card compliantwith PCMCIA (Personal Computer Memory Card International Association).

The IEEE (Institute of Electrical and Electronics Engineers) 1394 port101 has a construction compliant with the IEEE 1394 standard and isconnected to a cable compliant with the IEEE 1394 standard.

The memory stick slot 115 accommodates a Memory Stick (trade mark) 116based on a semiconductor memory such as a flash memory which storesstill picture, moving picture, audio data, or text data.

The following describes the configuration of one embodiment of thepersonal computer 1 with reference to FIG. 5.

A central processing unit (CPU) 51 is a Pentium (trade mark) processorof Intel Corporation for example and is connected to a host bus 52. Thehost bus 52 is connected to a bridge 53 (a so-called north bridge). Thebridge 53 has an AGP (Accelerated Graphics Port) 50 and is connected toa PCI (Peripheral Component Interconnect/Interface) bus 56.

The bridge 53 is the 400BX, which is the AGP host bridge controller ofIntel Corporation, for example, and controls the data transmissionassociated with the CPU 51 and a RAM (Random Access Memory) 54 (aso-called main memory). In addition, the bridge 53 controls thetransmission of data with a video controller 57 via the AGP 50. Itshould be noted that the bridge 53 and a bridge 58 (a so-called southbridge (PCI-ISA Bridge)) constitute a so-called chipset.

The bridge 53 is also connected to a cache memory 55. The cache memory55 is based on a memory chip which is faster in access than the RAM 54based on an SRAM (Static RAM), thereby caching (namely temporarilystoring) the programs and data to be used by the CPU 51.

It should be noted that the CPU 51 incorporates a primary cache memory(which operates faster than the cache memory 55 and is controlled by theCPU 51 itself).

The RAM 54, based on a DRAM (Dynamic RAM) for example, stores theprograms to be executed by the CPU 51 and the data necessary for the CPU51 to operate. To be more specific, the RAM 54 stores, upon completionof a bootup sequence of the personal computer 1, an electronic mailprogram 54A, an auto pilot program 54B, a jog dial status monitorprogram 54C, a jog dial driver 54D, an operating system (OS) 54E, adisplay program 54F, a reading program 54G, and other applicationprograms 54H1 through 54Hn loaded from a HDD 67.

It should be noted that the display program 54F and the reading program54G may be adapted to start when the memory stick 116 is loaded into thememory stick slot 115.

The electronic mail program 54A transfers communication text (so-callede-mail) over a communication line such as a telephone line 76 via amodem 75. The electronic mail program 54A has a incoming mail capturecapability. This incoming mail capture capability checks to see if amail addressed to the user has arrived in a mail box 79 of a mail server78 of an Internet service provider 77 and, if such a mail is found,executes a mail capture process.

The auto pilot program 54B sequentially starts plural predeterminedprocesses (or programs) in a predetermined order.

The jog dial status monitor program 54C receives the information fromeach of the above-mentioned application programs indicative of whetherit complies with the jog dial 4. If the compliance is found, thisprogram displays on the LCD 7 what can be done by operating the jog dial4.

The jog dial status monitor program 54C detects a jog dial event (therotation of the jog dial 4 in the direction of arrow “a” or the pressingin the direction of arrow “b” for example) and executes a processcorresponding to the detected event. The jog dial status monitor program54C has a list for receiving the notifications from applicationprograms. The jog dial driver 54D executes various capabilities inaccordance with the operations of the jog dial 4.

The OS (Operating System) 54E is a program, typically Windows 95 (trademark) or Windows 98 (trade mark) of Microsoft Corporation or Mac OS(trademark) of Apple Computer for example, which controls the basicoperations of the computer.

The display program 54F displays on the LCD 7 a thumbnail correspondingto a file (storing data such as moving picture, still picture, audiodata, or text data (hereafter also referred to as content) stored in thememory stick 116 loaded in the memory stick slot 115. Referring to thethumbnail displayed on the LCD 7, the display program 54F operates(copies, moves, or deletes for example) a file stored in the memorystick 116.

The reading program 54G reads a file from the memory stick loaded in thememory stick slot 115 and supplies the data stored in the file to thedisplay program 54F.

The video controller 57 is connected to the bridge 53 via the AGP 50 andreceives data (image data or text data for example) from the CPU 51 viathe AGP 50 and the bridge 53 to generate the image data corresponding tothe received data or stores the received data without change into anincorporated video memory. The video controller 57 displays on the LCD 7of he display section 3 an image corresponding to the image data storedin the video memory.

The PCI bus 56 is connected to a sound controller 64. The soundcontroller 64 captures a signal representing a voice inputted from themicrophone 66, generates a corresponding audio data, and outputs theaudio data to the RAM 54. Also, the sound controller 64 drives a speaker65 to sound audio data therefrom.

The PCI bus 56 is also connected to the modem 75. The modem 75 sendspredetermined data to a communication network 80 such as the Internet orthe mail server 78 through a telephone line 76 and the Internet serviceprovider 77 and receives predetermined data from the communicationnetwork 80 or the mail server 78.

The PC card interface 111, connected to the PCI bus 56, supplies thedata from an interface card 112 loaded in the slot 9 to the CPU 51 orthe RAM 54 and outputs the data supplied from the CPU 51 to theinterface card 112. A drive 113 is connected to the PCI bus 56 via thePC card interface 111 and the interface card 112.

The drive 113 reads data from a magnetic disc 121, an optical disc 122,a magneto-optical disc 123, a semiconductor memory 124 loaded in thedrive 113 and supplies the data to the RAM 54 via the PC card interface111, the interface card 112, and the PCI bus 56.

The memory stick interface 114, connected to the PCI bus 56, suppliesthe data from the memory stick 116 loaded in the memory stick slot 115to the CPU 51 or the RAM 54 and outputs the data supplied from the CPU51 to the memory stick 116.

The PCI bus is also connected to the bridge 58 (a so-called southbridge). The bridge 58 is based on the PIIX4 of Intel Corporation forexample and incorporates an IDE (Integrated Drive Electronics)controller/configuration register 59, a timer circuit 60, an IDEinterface 61, and a USB interface 68. The bridge 58 controls various I/O(Input/Output) operations such as control of a device connected to theIDE bus 62 or connected via an ISA/EIO (Industry StandardArchitecture/Extended Input Output) bus 63 or an I/O interface 69.

The IDE controller/configuration register 59 is composed of two IDEcontrollers; a so-called primary IDE controller and a so-calledsecondary IDE controller and a configuration register (each not shown).

The primary IDE controller is connected to the HDD 67 via the IDE bus62. The secondary IDE controller is electrically connected to so-calledIDE devices such as a CD-ROM drive or a HDD both not shown when theseIDE devices are connected to another IDE bus.

The HDD 67 stores an electronic mail program 67A, an auto pilot program67B, a jog dial status monitor program 67C, a jog dial driver 67D, an OS67E, application programs such as a display program 67F and a readingprogram 67G and others 67H1 through 67Hn. The electronic mail program67A, the auto pilot program 67B, the jog dial status monitor program67C, the jog dial driver 67D, the OS 67E, application programs such asthe display program 67F and the reading program 67G and others 67H1through 67Hn stored in the HDD 67 are sequentially supplied and loadedinto the RAM 54 in a bootup sequence for example.

The USB interface 68 sends data to a device connected via a USB port 107and receives data from the device.

The timer circuit 60 supplies the data indicative of current time uponrequest by the display program 67F to the CPU 51 via the PCI bus 56.Referring to the current time data supplied from the timer circuit 60,the display program 67F can know an elapsed time for example.

The ISA/EIO bus 63 is also connected to the I/O interface 69. In the I/Ointerface 69, constituted by an embedded controller, a ROM 70, a RAM 71,and a CPU 72 are interconnected.

The ROM 70 stores an IEEE 1394 interface program 70A, a LED controlprogram 70B, a touch pad input monitor program 70C, a key input monitorprogram 70D, a wakeup program 70E, and a jog dial status monitor program70F in advance.

The IEEE 1394 interface program 70A sends and receives data (the datastored in packet) compliant with the IEEE 1394 standard via the IEEE1394 port 101. The LED control program 70B controls the turn-on/off ofthe power light PL, the battery light BL, the message light ML asrequired, and other LED lights. The touch pad input monitor program 70Cmonitors the input made by the user from the touch pad 6.

The key input monitor program 70D monitors the input made by the userfrom the keyboard 5 or other key switches. The wakeup program 70E, whichexecutes power management on each chip constituting the personalcomputer 1, checks, on the basis of the current time data supplied fromthe timer circuit 60 of the bridge 58, whether a predetermined time hasbeen reached and, when the predetermined has been reached, starts apredetermined process (or a program). The jog dial status monitorprogram 70F always monitors whether the rotary encoder of the jog dial 4has been operated or the jog dial 4 itself has been pushed.

The ROM 70 also stores a BIOS (Basic Input/Output System) 70G. The BIOS70G controls data transfer (input/output) between the OS or anapplication program and peripheral devices (the touch pad 6, thekeyboard 5, the HDD 67, etc.).

The RAM 71 stores registers 71A through 71F, namely a LED controlregister, a touch pad input status register, a key input statusregister, a setting time register, a jog dial status monitor I/Oregister, and an IEEE 1394 I/F register. For example, the LED controlregister holds a predetermine value when the jog dial 4 is pressed tostart the electronic mail program 54A, thereby controlling the turn-onof the message light ML in accordance with the stored value. The keyinput status register holds a predetermined operated key flag when thejog dial 4 is pressed. The setting time register holds a predeterminedtime when the user operates the keyboard 5 for example.

The I/O interface 69 is connected to the jog dial 4, the touch pad 6,the keyboard 5, and the IEEE 1394 port 101 through the correspondingconnectors, not shown, and outputs the signals corresponding to theoperations made on these input devices to the ISA/EIO bus 63. Also, theI/O interface 69 controls the transfer of data with the devicesconnected via the IEEE 1394 port 101. The I/O interface 69 is alsoconnected to the power light PL, the battery light BL, the message lightML, a power control circuit 73, and other LED lights.

The power control circuit 73, connected to an incorporated battery 74 oran AC power outlet, supplies power to each block constituting thepersonal computer and controls the charging of the incorporated battery74 and a second battery of each peripheral device. The I/O interface 69monitors the power switch 8 which turns on/off the power to the personalcomputer.

The I/O interface 69 executes the programs, the IEEE 1394 interfaceprogram 70A through the jog dial status monitor program 70F, on theinternally supplied power if the externally supplied power is off.Namely, the programs, the IEEE 1394 interface program 70A through thejog dial status monitor program 70F, are always operating.

Therefore, if the power switch 8 is off and the CPU 51 is not executingthe OS 54E, the I/O interface 69 executes the jog dial status monitorprogram 70F, so that, when the jog dial 4 is pressed in the power savemode or with the power being off, the personal computer 1 starts theprocessing of a predetermined software program or script file.

Thus, in the personal computer 1, the jog dial 4 has a programmable key(PPK) function, so that no dedicated key need be arranged.

FIG. 6 shows the configurations of the display program 54F and thereading program 54G to be executed by the personal computer 1. Thedisplay program 54F includes a processing manager 151, contentprocessing routines 152-1 through 152-N, and icon processing routines153-1 through 153-N.

The processing manager 151 computes, on the basis of an input eventsupplied from the touch pad 6 or the OS 54E, a position at which athumbnail corresponding to a file read from the memory stick 116 is tobe displayed and supplies a computation result to the content processingroutines 152-1 through 152-N. The thumbnail display position to besupplied by the processing manager 151 to the content processingroutines 152-1 through 152-N includes a depth (indicative of a virtualdistance from the surface of the LCD 7, determining, when two or morethumbnails overlap, which one is to be displayed on top and the size ofthe displayed thumbnail for example) in addition to a horizontally andvertically defined position on the LCD 7.

The processing manager 151 controls the periods of thumbnail display ofthe content processing routines 152-1 through 152-N.

The processing manager 151 computes an icon display position for exampleon the basis of an input event supplied from the touch pad 6 or the OS54E and supplies a computation result to the icon processing routines153-1 through 153-N. The processing manager 151 controls the periods oficon display of the icon processing routines 153-1 through 153-N.

The processing manager 151 sends display status information (thumbnaildisplay position, display period, and image color) to the contentprocessing routines 152-1 through 152-N on the basis of an input eventfor example supplied from the touch pad 6 or the OS 54E.

In response to an input from the touch pad 6 for example, the processingmanager 151 requests the OS 54E for copy, deletion, or transfer of thefiles corresponding to the thumbnails displayed by the contentprocessing routines 152-1 through 152-N.

In response to a request from the reading program 54G, the contentprocessing routines 152-1 through 152-N are started in the numbercorresponding to the number of files read from the memory stick 116.

For example, when 4 files have been read by the reading program 54G fromthe memory stick 116, the reading program 54G starts the contentprocessing routines 152-1 through 152-4. For example again, if 8 fileshave been read by the reading program 54G from the memory stick 116, thereading program 54G requests the starting of the content processingroutines 152-1 through 152-8.

Thus, the number of content processing routines 152-1 through 152-Ncorresponding to the number of files read by the reading program 54Gfrom the memory stick 116 are started. Actually, the display program 54Frepeats the execution of one routine by a predetermined number of times.Therefore, it appears that plural content processing routines 152-1through 152-N are running.

The content processing routine 152-1 displays one thumbnailcorresponding to one file read from the memory stick 116 onto the LCD 7as instructed by the processing manager 151. The content processingroutine 152-2 displays another thumbnail corresponding to another fileread from the memory stick 116 onto the LCD 7 as instructed by theprocessing manager 151. Likewise, the content processing routines 152-3through 152-N display thumbnails corresponding to files, one to one,read from the memory stick 116 onto the LCD 7 as instructed by theprocessing manager 151.

Thus, each of the content processing routines 152-3 through 152-Ndisplays one thumbnail as instructed by the processing manager 151 onthe LCD 7.

The icon processing routines 153-1 through 153-N are started in thenumber corresponding to the number of icons to be described later.

The icon processing routine 153-1 displays one icon onto the LCD 7 asinstructed by the processing manager 151. The icon processing routine153-2 displays another icon onto the LCD 7 as instructed by theprocessing manager 151. Likewise, the icon processing routines 153-3through 153-N display different icons onto the LCD 7 as instructed bythe processing manager 151.

Thus, the each of the icon processing routines 153-1 through 153-Ndisplays one icon onto the LCD 7 as instructed by the processing manager151.

When one file has been read from the memory stick 116, the readingprogram 54G starts one of the content processing routines 152-1 through152-N and supplies the data stored in that file to one started contentprocessing routine of the content processing routines 152-1 through152-N.

When a file has been read from the communication network 80 such as theInternet, the reading program 54G may start one of the contentprocessing routines 152-1 through 152-N and supply the data stored inthat file to one started content processing routine of the contentprocessing routines 152-1 through 152-N.

In what follows, if there is no need to make distinction between thecontent processing routines 152-1 through 152-N, the content processingroutines are generically referred to simply as the content processingroutine 152. It should be noted that the content processing routines152-1 through 152-N may be executed as different tasks which runconcurrently with each other. In what follows, if there is no need tomake distinction between the icon processing routines 153-1 through153-N, the icon processing routines are generically referred to simplyas the icon processing routine 153.

The following sequentially describes the screens to be displayed by thedisplay program 54F onto the LCD 7 in correspondence to the operationsexecuted by the personal computer 1 which are assumed as normaloperations.

FIGS. 7 through 9 shows the screens to be displayed on the LCD 7 whenthe memory stick 116 storing 10 files for example is loaded in thememory stick slot 115 and the display program 54F is started.

When the reading program 54G reads one file from the memory stick 116,starts one content processing routine 152 and the display program 54Fdisplays a thumbnail corresponding to the data stored in the file read.

FIG. 7 shows an exemplary screen to be displayed by the display program54F onto the LCD 7 when 3 files of the 10 files stored in the memorystick 116 have been read by the reading program 54G after starting ofthe display program 54F.

A thumbnail 201-1 is displayed by the content processing routine 152-1and is constituted by an image corresponding to the data stored in thefile read first by the reading program 54G from the memory stick 116. Athumbnail 201-2 is displayed by the content processing routine 152-2 andis constituted by an image corresponding to the data stored in the fileread second by the reading program 54G from the memory stick 116. Athumbnail 201-3 is displayed by the content processing routine 152-3 andis constituted by an image corresponding to the data stored in the fileread third by the reading program 54G from the memory stick 116.

As described later, the thumbnails 201-1 through 201-3 are arrangedalong a virtually spiral. In what follows, unless it is necessary tomake distinction between the thumbnails 201-1 through 201-N, they aregenerically referred to simply as the thumbnail 201.

The content processing routine 152 generates the thumbnail 201 inaccordance with the type of the data supplied from the reading program54G.

For example, receiving moving image data from the reading program 54G,the content processing routine 152 generates the thumbnail 201 on thebasis of the first image of the moving image data.

Receiving still image data of TIFF (Tag Image File Format) or GIF(Graphic Interchange Format), the content processing routine 152generates the thumbnail 201 from the still image data. Receiving stillimage data of JPEG (Joint Photographic Experts Group), the contentprocessing routine 152 uses the thumbnail data stored in the header ofthe received data.

Receiving audio or text data from the reading program 54G, the contentprocessing routine 152 generates an image from the received audio ortext data and uses the generated image as the thumbnail 201. Theprocessing by the content processing routine 152 of generating an imageas the thumbnail 201 on the basis of audio or text data will bedescribed later.

Icons for specifying the arrangement of the thumbnails 201 are displayedin the bottom of the screen displayed by the display program 54F ontothe LCD 7. An icon 202-1 instructs the display program 54F to arrangethe thumbnails 201 on a virtually straight line. An icon 202-2 instructsthe display program 54F to arrange the thumbnails 201 around a virtualtrue circle or ellipse. An icon 202-3 instructs the display program 54Fto arrange the thumbnails 201 in a lattice manner. An icon 202-4instructs the display program 54F to arrange the thumbnails 201 along avirtual spiral.

Because the icon 202-4 is selected and arranged at lower center of thescreen, the display program 54F arranges the thumbnails 201-1 through201-3 along a virtual spiral. In what follows, unless it is necessary tomake distinction between the icons 202-1 through 202-4, they aregenerically referred to simply as the icon 202.

When such processes for the files corresponding to the thumbnails 201-1through 201-3 as enlarge, reproduce, attribute information display,copy, delete, and transfer are requested by the user from the jog dial4, the keyboard 5, or the touch pad 6, the display program 54F executesthe requested processing on the files corresponding to the thumbnails201-1 through 201-3. For example, if the request comes from the touchpad 6, the processing manager 151 requests the OS 54E to execute a copy,delete, or transfer operation on the files corresponding to thethumbnails 201-1 through 201-3.

FIG. 8 shows an exemplary screen to be displayed by the display program54G onto the LCD 7 when 7 files of the 10 files stored in the memorystick 116 have been read by the reading program 54G after starting ofthe display program 54F.

The thumbnail 201-4 is displayed by the content processing routine 152-4and is constituted by an image corresponding to the data contained inthe file read fourth by the reading program 54G from the memory stick116. The thumbnail 201-5 is displayed by the content processing routine152-5 and is constituted by an image corresponding to the data containedin the file read fifth by the reading program 54G from the memory stick116.

The thumbnail 201-6 is displayed by the content processing routine 152-6and is constituted by an image corresponding to the data contained inthe file read sixth by the reading program 54G from the memory stick116. The thumbnail 201-7 is displayed by the content processing routine152-7 and is constituted by an image corresponding to the data containedin the file read seventh by the reading program 54G from the memorystick 116.

The thumbnails 201-1 through 201-7 are arranged along a virtual spiral.

When such processes for the files corresponding to the thumbnails 201-1through 201-7 as enlarge, reproduce, attribute information display,copy, delete, and transfer are requested by the user from the jog dial4, the keyboard 5, or the touch pad 6, the display program 54F executesthe requested processing on the files corresponding to the thumbnails201-1 through 201-7. For example, if the request comes from the touchpad 6, the processing manager 151 requests the OS 54E to execute a copy,delete, or transfer operation on the files corresponding to thethumbnails 201-1 through 201-7.

FIG. 9 shows an exemplary screen to be displayed by the display program54F onto the LCD 7 when all files have been read by the reading program54G from the memory stick 116-after the starting of the display program54F.

The thumbnail 201-8 is displayed by the content processing routine 152-8and is constituted by an image corresponding to the data contained inthe file read eighth by the reading program 54G from the memory stick116. The thumbnail 201-9 is displayed by the content processing routine152-9 and is constituted by an image corresponding to the data containedin the file read ninth by the reading program 54G from the memory stick116. The thumbnail 201-10 is displayed by the content processing routine152-10 and is constituted by an image corresponding to the datacontained in the file read tenth by the reading program 54G from thememory stick 116.

The thumbnails 201-1 through 201-10 are arranged along a virtual spiral.

When such processes for the files corresponding to the thumbnails 201-1through 201-10 as enlarge, reproduce, attribute information display,copy, delete, and transfer are requested by the user from the jog dial4, the keyboard 5, or the touch pad 6, the display program 54F executesthe requested processing on the files corresponding to the thumbnails201-1 through 201-10. For example, if the request comes from the touchpad 6, the processing manager 151 requests the OS 54E to execute a copy,delete, or transfer operation on the files corresponding to thethumbnails 201-1 through 201-10.

Thus, when the reading program 54G reads files from the memory stick116, the display program 54F sequentially displays the thumbnails 201corresponding to the data contained in these files, so that the user ofthe personal computer 1 can know the contents of the files stored in thestick memory 116 and a file read state at that point of time.

When the reading program 54G reads files from the memory stick 116, thedisplay program 54F executes a process requested at that point of timeon the files.

If the reading of files is slow, the display program 54F sequentiallydisplays the thumbnails 201 corresponding to the data contained in thefiles, so that the user can determine an operation to be executed nextby referring to the displayed thumbnails 201.

The processes executable on the files corresponding to the thumbnails201-1 through 201-3 shown in FIG. 7 are the same as those executable onthe files corresponding to the thumbnails 201-1 through 201-7 shown inFIG. 8 and those executable on the files corresponding to the thumbnails201-1 through 201-10 shown in FIG. 9.

The following describes the thumbnail 201 for displaying an imagecorresponding to audio or text data. Conventionally, as shown in theleft side in FIG. 10, an icon representing a recorded voice isdisplayed. In this example, if there are plural pieces of voice data,corresponding icons having a same shape are displayed.

On the contrary, as shown in the right side of FIG. 10, the displayprogram 54F generates an image corresponding to audio data or text datathemselves and displays the generated image as the thumbnail 201.

FIG. 11 shows a procedure of generating the thumbnails 201 fordisplaying an image corresponding to audio data by the contentprocessing routine 152.

First, the content processing routine 152 sets an area in which thethumbnail 201 is displayed in accordance with its size. In accordancewith the size of the audio data, the content processing routine 152divides the area for displaying the thumbnail 201 into square areas eachconsisting of the predetermined number of pixels.

The content processing routine 152 extracts the data of a given portion(for example, if the audio data are viewed as a data sequence, the datalocated at the center of the data sequence) from the audio data andgenerates the pixel value of each pixel on the basis of the extracteddata. For example, the content processing routine 152 extracts data fromthe audio data in units of 8 bits to provide RGB data.

In the example shown in FIG. 11, 0fh (hereafter each hexadecimal valueis suffixed with “h”) extracted from the audio data provides R data, 7ehprovides G data, and 57h provides B data. Likewise, 0fh, 7eh, and 57hare followed by 12h providing R data, 25h providing G data, and 98hproviding B data.

When the audio data are encrypted or encoded, the content processingroutine 152 does not decode the audio data but generates RGB datadirectly from the encrypted or decoded audio data.

Thus, the content processing routine 152 generates the same number ofpixel values of RGB data as the number of divided thumbnail-areas.

The content processing routine 152 sets the RGB data to each of squareareas each consisting of the predetermined number of pixels, obtained bydividing an area to be displayed by the thumbnail 201. At this point oftime, the thumbnail 201 consists of an image in which each square has adifferent color as shown in the example of image 1 of FIG. 11.

The content processing routine 152 then applies a blur process to thethumbnail 201 to which the RGB data are set. Blurring the thumbnail 201with RGB data set makes the displayed thumbnail 201 easier to be seen asshown in the example of image 2 shown in FIG. 11.

In addition to the blur process, the content processing routine canapply any other image processes such as emboss and outline extraction tothe thumbnail 201 with RGB data set.

Further, the content processing routine 152 writes the attribute datasuch as title, artist, and play time contained in the audio file overpredetermined positions in text as shown in the example of image 3 shownin FIG. 11.

Because the content processing routine 152 writes the attribute datasuch as title, artist, and play time contained in the audio file overpredetermined positions in text, the user viewing the thumbnail 201corresponding to the audio data can know in detail the contents of theaudio data corresponding to the thumbnail 201.

The image to be set to the thumbnail 201 may be generated on the basisof the spectrum corresponding to audio data. For example, colorscorresponding to the frequency band levels of the horizontally alignedpixels of the thumbnail 201 may be set (for example, −40 dB is relatedto a color of hue circle 0 degree and 0 dB is related to a color of huecircle 360 degrees) and the vertically aligned pixels of the thumbnail201 may be related to an audio elapsed time, thereby setting an imagecorresponding to the elapsed time of the audio spectrum all over thethumbnail 201.

As shown in FIG. 12, when the audio data are small in size, the contentprocessing routine 152 divides the area for displaying the thumbnail 201into a small number of square areas and, when the audio data are largein size, the content processing routine 152 divides the area into alarge number of square areas.

By doing so, the user of the personal computer 1 can predict the size ofaudio data only by viewing the thumbnail 201 corresponding to the audiodata.

As shown in FIG. 13, the content processing routine 152 generates thethumbnail 201 on the basis of text data in the same procedure asgenerating the thumbnail 201 corresponding to audio data. In this case,the content processing routine 152 may extract predetermined summarytext of text included in the text data as the text to be displayed onthe thumbnail 201 and display the extracted text.

Thus, the display program 54F can generate the thumbnail 201 incorrespondence with audio data or text data.

The data which can be processed by the display program 54F are notlimited to audio data and text data. For example, the display program54F can generate the thumbnail 201 on the basis of data including noimage, for example, data stored in an HTML (Hypertext Markup Language)file, data for spreadsheeting, and an execution program (a load module).

The following describes the arrangement of the thumbnails 201 to bedisplayed by the display program 54F.

Conventionally, when arranging thumbnails and accompanying information,it is a general practice for the thumbnails to be arranged notoverlapping each other and the accompanying information to be displayednearby.

On the contrary, the display program 54F of the personal computer 1provides three types of arranging thumbnails 201 in addition to adisplay method in which the thumbnails 201 are arranged in a lattice,not overlapping each other (this method is hereafter referred to assquare view).

In the first display embodiment, a virtual straight line or a virtualcurve (an open line) is specified and the thumbnails 201 are arranged onthe specified virtual line (this display method is hereafter referred toas a line view). In the second display embodiment, a virtual true circleor a virtual ellipse (a closed line) is specified and the thumbnails 201are arranged about the circle or ellipse (this display method ishereafter referred to as a loop view). In the third display embodiment,a virtual spiral is specified and the thumbnails 201 are arranged on thespiral (this display method is hereafter referred to as a spiral view).

First, line view to be displayed when the icon 202-1 is clicked will bedescribed. As shown in FIG. 15, the display program 54F specifies anaxis 221-1 consisting of a straight line or circle and arranges thethumbnails 201-1 through 201-3 on this line. If the thumbnail 201-1 isselected and the thumbnail 201-1 overlaps the thumbnail 201-2, thedisplay program 54F displays the entire thumbnail 201-1 and only theexposed portion of the thumbnail 201-2.

If the thumbnail 201-1 is selected and the thumbnail 201-2 overlaps thethumbnail 201-3, the display program 54F displays only the exposedportion of the thumbnail 201-2 and the exposed portion of the thumbnail201-3.

Namely, the display program 54F displays the entire selected thumbnail201 and displays the thumbnail 201 nearer to the selected thumbnail 201preferentially over the thumbnail 201 farther from the selectedthumbnail 201 (so that the nearer thumbnail is displayed nearer to theuser).

A text 211-1 indicative of such information accompanying the thumbnail201-1 as file name, date of creation, and image size, is arranged on anaxis 221-2 at which the lower position of the thumbnail 201-1 matchesthe upper position of the text 211-1 for example. A text 211-2indicative of such information accompanying the data corresponding tothe thumbnail 201-2 as file name is arranged on the axis 221-2 at whichthe lower position of the thumbnail 201-2 matches the upper position ofthe text 211-2 for example. A text 211-3 indicative of such informationaccompanying the data corresponding to the thumbnail 201-3 as file nameis arranged on the axis 221-2 at which the lower position of thethumbnail 201-3 matches the upper position of the text 211-3 forexample.

It should be noted that the axes 221-1 and 221-2 are not displayed onthe screen of the LCD 7. In what follows, if there is no need to makedistinction between the axes 221-1 and 221-2, they will be genericallyreferred to simply as the axis 221. Likewise, the texts 211-1 through211-3 will be generically referred to simply as the text 211 when thereis no need to make distinction among them.

For example, let the horizontal direction of the screen be x axis andthe vertically direction be axis y, then, as shown in FIG. 16, the axis221-1 is computed by equation (1) and the axis 221-1 by equation (2).x=sin(π/2t)(y−c0)+c1  (1)x=−sin(π/2t)(y−c0)+c1  (2)

where, x and y denote coordinates on x axis and y axis respectively, tdenotes a time elapsed from a predetermined reference time (for example,a time corresponding to the start of displaying icons in the line view,and c0 and c1 denote the centers of the displayed thumbnails.

θ shown in FIG. 16 corresponds to π/2t of equation (1) or (2).

Therefore, if a display operation starts with the thumbnail 201 and thetext 211 positioned as shown in FIG. 17B with reference to the positionsof the axes 221-1 and 221-2 as shown in FIG. 17A, the positions of theaxes 221-1 and 221-2 smoothly move toward the positions shown in FIG.17C and then the positions shown in FIG. 17E.

Namely, the thumbnail 201 and the text 211 are smoothly rearranged froma state shown in FIG. 17B to a state shown in FIG. 17D in correspondencewith the movement of the axes 221-1 and 221-2 then to a state shown inFIG. 17F.

Having reached the positions shown in FIG. 17E, the axes 221-1 and 221-2smoothly move to the positions shown in FIG. 17C and then to thepositions shown in FIG. 17A, repeating the smooth movement.

Namely, the thumbnail 201 and the text 211 are smoothly rearranged fromthe state shown in FIG. 17F to the state shown in FIG. 17D incorrespondence with the movement of the axes 221-1 and 221-2 and then tothe state shown in FIG. 17B, repeating the smooth movement.

Because the selected thumbnail 201 is located at the center of movementof the axis 221-1, the thumbnail 201 selected by the user remainsunmoved and the thumbnails located over and below it move. This allowsthe user quickly and surely recognize the selected thumbnail 201.

The following describes a loop view which is displayed when the icon202-2 is clicked. As shown in FIG. 18, the display program 54F specifiesan axis 241-1 consisting of a true circle, an ellipse, or apredetermined loop (including a polygon) and arranges the thumbnails201-1 through 201-5 on the axis 241-1. If the thumbnail 201-3 isselected and it overlaps the thumbnail 201-2, the display program 54Fdisplays the entire thumbnail 201-3 and only the exposed portion of thethumbnail 201-2.

If the thumbnail 201-3 is selected and the thumbnails 201-1 through201-5 are sequentially arranged and the thumbnail 201-2 overlapsthumbnail 201-1, the display program 54F displays only the exposedportion of the thumbnail 201-2 and only the exposed portion of thethumbnail 201-1. The display program 54F displays only the exposedportion of the thumbnail 201-4 and only the exposed portion of thethumbnail 201-5.

Namely, the display program 54F displays the entire selected thumbnails201 and displays the thumbnails 201 nearer to the selected thumbnail 201preferentially over the thumbnails 201 farther from the selectedthumbnail 201 (so that the nearer thumbnail is displayed nearer to theuser).

The display program 54F specifies an axis 241-2 which corresponds to theaxis 241-1. The text 211-1 corresponding to the thumbnail 201-1 isarranged on the 241-2 at which the center of the thumbnail 201-1 matchesthe center of the text 211-1 for example. The text 211-2 correspondingto the thumbnail 201-2 is arranged on the axis 241-2 at which thehorizontal center of the thumbnail 201-2 matches the center of the text211-2. Likewise, the texts 211-3 through 211-5 are arranged on the axis241-2 at which the horizontal centers of the thumbnails 201-3 through201-5 match the center of the texts 211-3 through 211-5 respectively.

It should be noted that the axes 241-1 and 241-2 are not displayed onthe screen of the LCD 7. In what follows, if there is no need to makedistinction between the axes 241-1 and 241-2, they will be referencedsimply as the axis 241.

As shown in FIG. 19, the display program 54F displays the thumbnails 201arranged on the axis 241-1 and the texts 211 arranged on the axis 241-2with the selected thumbnail 201 being at the center of the screen on theLCD 7.

FIG. 20 illustrates how the display program 54F computes the axes 241-1and 241-2 if the axes 241-1 and 241-2 are true circles.

Let the number of thumbnails 201 to be displayed be n, then the radius rof the circle corresponding to the axes 241-1 and 241-2 can be obtainedfrom equation (3).r=64n/2π  (3)

Let the coordinates of the center of the screen be (Xcent,Ycent), thenthe coordinates of the center of the axis 241-1 (Xcent1,Ycent1) can beobtained from equation (4) and the coordinates of the center of the axis241-2 (Xcent2,Ycent2) can be obtained from equation (5).(Xcent1,Ycent1)=(Xcent,Ycent−r−64)  (4)(Xcent2,Ycent2)=(Xcent,Ycent+r+64)  (5)

The position of ith thumbnail 201 can be obtained from equation (6).(X1i,Y1i)=(Xcent1+rsin(i*2π/n), Ycent1+rcos(i*2π/n))  (6)

The position of the ith text 211 can be obtained from equation (7).(X2i,Y2i)=(Xcent2+r sin(i*2π/n), Ycent2−rcos(i*2π/n))  (7)

Consequently, the loop view facilitates for the user to intuitivelygrasp the movement of the thumbnail 201 when the display program 54Fchanges in the loop view the position of the thumbnail 201 in responseto the operation of the jog dial 4.

The following describes the spiral view which is displayed when the icon202-4 is clicked. As shown in FIG. 21, the display program 54F specifiesan axis 261 consisting of a spiral and arranges the thumbnails 201-1through 201-3 and the texts 211-1 through 211-3 on the axis 261. Theaxis 261 runs in the depth of the screen. If all the thumbnails 201 hasa same size, the size as displayed on the LCD 7 differs as the positionof arrangement on the axis 261 differs.

Because the selected thumbnail 201 is located foremost toward the user,the display program 54F displays it largest compared with others,unselected thumbnails 201 being shown smaller.

Thus, the display program 54F, while displaying many thumbnails 201,displays the selected thumbnail 201 largest and the unselectedthumbnails smaller, thereby enhancing the usage efficiency of the screenon the LCD 7.

As shown in FIG. 22A, the display program 54F may also specify axes261-1 and 261-2 having a same axis and arrange thumbnails 201 on theaxis 261-1 and arrange texts 211 on the axis 261-2.

The coordinates (x,y,z) of the axis 261 consisting of a spiral havingradius r can be obtained from equations (8), (9), and (10).x=rsin(t)+c0t  (8)y=c1t  (9)z=rcos(t)  (10)

where, r is the radius of the spiral, c0 and c1 are constants fordefining the slope of the spiral, and t is a given value.

As shown in FIG. 23, the coordinates (xi,yi,zi) of the thumbnail 201arranged on the axis 261 consisting of a spiral having radius r can beobtained from equations (11), (12), and (13)xi=Xcent+rsin(i*2π/9)−(i*r/20)  (11)yi=Ycent+(i*r/10)  (12)zi=r−rcos(i*2π/9)  (13)

where, Xcent and Ycent denote the coordinates of the center of thescreen. The z axis is at right angles to the x axis and y axis, runningin the depth of the screen. 20 in equation (11) and 10 in equation (12)are predetermined contents.

The following describes the square view which is displayed when the icon202-3 is clicked. As shown in FIGS. 24 and 25 for example, the displayprogram 54F arranges, as the top row of the screen, the 5 thumbnails201-1 through 201-5 such that they are aligned on their vertical centersand equally spaced from each other on their horizontal centers.

The display program 54F arranges, as the second row from top, another 5thumbnails 201-6 through 201-7 such that such that they are aligned ontheir vertical centers and equally spaced from each other on theirhorizontal centers. In other words, the display program 54F arranges the5 thumbnails 201-6 through 201-10 on the second row such that thehorizontal center of the thumbnail 201-6 matches the horizontal centerof the thumbnail 201-1, the horizontal center of the thumbnail 201-7matches the horizontal center of the thumbnail 201-2, the horizontalcenter of the thumbnail 201-8 matches the horizontal center of thethumbnail 201-3, the horizontal center of the thumbnail 201-9 matchesthe horizontal center of the thumbnail 201-4, and the horizontal centerof the thumbnail 201-10 matches the horizontal center of the thumbnail201-5.

The display program 54F arranges, as the third and fourth rows of thescreen, the thumbnails 201-11 through 201-20 in the above-mentionedprocedure.

It should be noted that the display program 54F can rearrange thethumbnails 201 in accordance with date of creation, time of imaging,file name, and image size for example, in any of the line view, the loopview, the spiral view, and the square view.

The following describes how the icon 202 moves when it is clicked. FIG.26 shows one example of how the icon 202 moves.

As shown to the right side of FIG. 26, if icons 202-1 through 202-3 forexample are arranged in the screen and when the icon 202-1 is clicked,the display program 54F moves the icon 202-1 and 202-2 such that theshape or color of the icon 202-1 is changed to reproduce a predeterminedvoice and the positions of the icon 202-1 and 202-2 are exchanged.

Namely, the processing manager 151 computes the positions of the icons202-1 and 202-2 such that, when the touch pad 6 is operated, the icons202-1 and 202-2 move at a predetermined period.

On the basis of the position computed by the processing manager 151, theicon processing routine 153-1 displays the icon 202-1 such that it movesto the center of screen. On the basis of the position computed by theprocessing manager 151, the icon processing routine 153-2 displays theicon 202-2 such that it moves to the lower left of the screen.

The icons 202-1 through 202-3 are not limited to move straight; they maymove on predetermined curves. The directions in which the icons 202-1through 202-3 move are not limited to planar; they may move also in thedepth of the screen.

When the thumbnails 201 are displayed in the loop view, the displayprogram 54F, as shown in FIG. 27A, the display program 54F arranges theicon 202-2 at the horizontal center of screen. When the icon 202-1 isclicked in the state shown in FIG. 27A, the display program 54F movesthe icons 202-1 through 202-4 with at a speed the user can visuallycheck the movement. After a state shown in FIG. 27B, the display program54F arranges the icon 202-1 to the horizontal center of screen as shownin FIG. 27C.

The display program 54F arranges the icons 202-2 through 202-4 inaccordance with the values related to them respectively.

For example, if 1 is related to the icon 202-1, 2 to the icon 202-2, 3to the icon 202-3, and 4 to the icon 202-4, the display program 54Farranges the icons 202-2 through 202-4 from the left of the screen inthe ascending order of the attached numbers. Namely, the display program54F arranges the icon 202-2 to the leftmost side of the screen, followedto the right by the icon 202-3, which is followed to the right by theicon 202-4.

Thus, when the display program 54F moves the icons 202 and arranges theicon 202 which corresponds to the display mode to the center of screenfor example, the user can surely know that the icon 202 has beenoperated and, at the same time, quickly know the display mode in whichthe thumbnail 201 is displayed.

The following describes how an after-image is displayed when thethumbnail 201 or the icon 202 is moved. The content processing routine152 draws the thumbnail 201 30 times a second for example. As shown inFIG. 28, the content processing routine 152 displays an after-image ofthe thumbnail 201 when it has been moved.

If the after-image display mode is not set in advance, the contentprocessing routine 152 erases the current screen and draws the thumbnail201 anew.

As shown in FIG. 29, if the after-image display mode is set, the contentprocessing routine 152, when drawing the thumbnail 201, draws it bysetting the lightness of the last displayed screen to 80% for example.The content processing routine 152 draws the thumbnail 201 over thescreen with the lightness set to 80%.

Therefore, when the thumbnail 201 is moved, the content processingroutine 152 decreases the lightness of the last displayed screen everytime the drawing is made, thereby leaving an after-image of thethumbnail 201. Thus, the display program 54F can display an after-imageby use of less computations than otherwise.

FIG. 30 illustrates a change in the states corresponding to the displaypositions of the thumbnail 201 or the icon 202 which has been moved.Referring to FIG. 30, state A relates to the loop view and state B tothe square view for example.

In state A corresponding to the loop view, when the icon 202-3 isclicked, the processing manager 151 computes the positions of thethumbnails 201-1 through 201-N to be drawn by the content processingroutines 152-1 through 152-N respectively and supplies the computedvalues to these content processing routines.

The processing manager 151 computes the positions of the thumbnails 201on the basis of a transition function indicative of a graph shown inFIG. 31. If a distance between the thumbnail 201 in state A and thethumbnail 201 in state B is 1, a distance of the thumbnail 201 atelapsed time t from the position of the thumbnail 201 in state B isoutputted as the transition function on the basis of elapsed time t fromthe start of the transition.

Namely, let elapsed time be ti, the position of the thumbnail 201 instate A be Ai, and the position of the thumbnail 201 in state B be Bi,then the position of the thumbnail 201 Ci can be obtained from equation(14).Ci=(Ai−Bi)d(ti)+Bi  (14)

The transition function is defined so that distance d(t) rapidlydecreases from 1 as elapsed time t increases in a portion in whichelapsed time t is near 0 and then distance d(t) gradually decreases to0. Defining the transition function this way allows the display program54F to quickly move the thumbnail 201 just after it is started and thendecreases the speed as the destination is reached.

Consequently, the display program 54F can quickly move the thumbnail 201without bothering the user with the movement.

The transition function is not limited to one shown in FIG. 31. Forexample, a transition function may be defined such that distance d(t)gradually decreases as elapsed time t increases in a portion in whichelapsed time t is near 0, and then distance d(t) quickly decreases to 0.

In response to elapsed time t and on the basis of the transitionfunction, the processing manager 151 computes the positions of thethumbnails 201-1 through 201-N corresponding to distance d(t) andsupplies the computed positions to the content processing routines 152-1through 152-N. The content processing routines 152-1 through 152-N drawthe thumbnails 201-1 through 201-N respectively.

In state C1 corresponding to elapsed time t1, the thumbnails 201-1through 201-N are displayed at their respective positions midway towardthe respective positions in state B. In state C2 corresponding toelapsed time t2 after a predetermined time from elapsed time t1, thethumbnails 201-1 through 201-N are displayed at their respectivepositions midway toward their respectively positions in state B.

In state C3 corresponding to elapsed time t3 after a predetermine timefrom elapsed time t2, the thumbnails 201-1 through 201-N are displayedat their respective positions which are nearer to their respectivepositions in state B than state C2.

FIG. 32 illustrates one example of the positions of the thumbnails 201in state C1 and state C2.

If a command for moving to state D is inputted for example while movingfrom state A to state B, the transient flow is directed toward state D.

As shown in FIG. 33 for example, if the icon 202-4 is clicked in stateC2, then the state of the icon 202-4 goes to state D which correspondsto the spiral view, with the state C2 as a new starting state. Thetransition from state C2 to state D is made via states E1 and E2 as withthe transition from state A to state B.

In the spiral view, the processing manager 151 changes the displaypositions of the thumbnails 201 as shown in FIG. 34 depending on whetherthe jog dial 4, the keyboard 5, or the touch pad 6 is being operated ornot.

Further, in the spiral view, the processing manager 151 changes thedisplay positions of the thumbnails 201 as shown depending on whetherthe keyboard 5 is kept pressed (for example, a direction key is keptpressed) or the keyboard 5 is pressed once and released immediately.

To be more specific, when the jog dial 4 and the keyboard 5 are notbeing operated, the processing manager 151 causes the content processingroutine 152 to display thumbnails 201 on a spiral having larger radius ras shown in FIG. 35 for example.

When the jog dial 4 is kept rotated or the keyboard 5 is kept pressed,the processing manager 151 causes the content processing routine 152 todisplay thumbnails 201 on a spiral having smaller radius r as shown inFIG. 36, for example.

When the jog dial 4 is clicked once or the keyboard 5 is pressed onceand released immediately, the processing manager 151 causes the contentprocessing routine 152 to display thumbnails 201 on a spiral havingintermediate radius r as shown in FIGS. 35 and 36.

Consequently, the user of the personal computer 1 can immediatelydetermine, on the basis of the display positions of thumbnails 201,whether the jog dial 4 or the keyboard 5 is being operated or not.

It should be noted that the display program 54F may reproduce apredetermined voice or display a predetermined image when the spiralradii r are changed.

When the jog dial 4 or the keyboard 5 is not being operated, theprocessing manager 151 may cause the content processing routine 152 todisplay thumbnails 201 on the spiral having smaller radius r and, whenthe jog dial 4 or the keyboard 5 is being operated, cause the contentprocessing routine 152 to display thumbnails 201 on the spiral havinglarger radius r.

The following describes how the thumbnail 201 is selected and displayedin an enlarged manner.

FIGS. 37 through 39 illustrate the selection and enlarged display ofthumbnails 201 in the line view. When a thumbnail 201 having “H” isclicked with a thumbnail 201 having “M” selected as shown in FIG. 37,the display program 54F moves all thumbnails 201 displayed on the screensuch that the thumbnail 201 having “H” comes to the center of the screenas shown in FIG. 38. The display program 54F then enters a state inwhich the thumbnail 201 having “H” is selected.

When the thumbnail 201 having “H” is clicked in the selected state shownin FIG. 38, the display program 54F displays an image corresponding tothe thumbnail 201 having “H” as shown in FIG. 39.

Namely, when the data corresponding to the thumbnail 201 having “H” area still image, the display program 54F displays it in its original size.If the data corresponding to the thumbnail 201 having “H” are a movingimage, the display program 54F displays it in its original size andreproduces the moving image. If the data corresponding to the thumbnail201 having “H” are a voice, the display program 54F displays it asenlarged to a predetermined size and reproduces the voice.

When an image corresponding to the thumbnail 201 having “H” shown inFIG. 39 is clicked, the display program 54F returns to the state inwhich the thumbnail 201 having “H” is selected shown in FIG. 38.

FIGS. 40 through 42 illustrate the selection and enlarged display ofthumbnails 201 in the loop view. When a thumbnail 201 having “Q” isclicked with a thumbnail 201 having “M” selected as shown in FIG. 40,the display program 54F moves all thumbnails 201 displayed on the screensuch that the thumbnail 201 having “Q” moves to the horizontal center ofthe screen as shown in FIG. 41. Then, the display program 54F enters thestate in which the thumbnail 201 having “Q” is selected.

When the thumbnail 201 having “Q” is clicked in the selected state shownin FIG. 41, the display program 54F displays an image corresponding tothe thumbnail 201 having “Q” as shown in FIG. 42.

Namely, when the data corresponding to the thumbnail 201 having “Q” area still image, the display program 54F displays it in its original size.When the data corresponding to the thumbnail 201 having “Q” are a movingimage, the display program 54F displays it in its original size andreproduces it. When the data corresponding to the thumbnail 201 having“Q” are a voice, the display program 54F displays the thumbnail 201 asenlarged to a predetermined size and reproduces the voice.

When an image corresponding to the thumbnail 201 having “Q” shown inFIG. 42 is clicked, the display program 54F returns to the state inwhich the thumbnail 201 having “Q” shown in FIG. 41 is selected.

FIGS. 43 through 45 illustrate the selection and enlarged display ofthumbnails 201 in the spiral view. When a thumbnail 201 having “Z” isclicked with a thumbnail 201 having “M” selected as shown in FIG. 43,the display program 54F moves all thumbnails 201 displayed on the screensuch that the thumbnail 201 having “Z” moves to the center of the screenas shown in FIG. 44. Then, the display program 54F enters the state inwhich the thumbnail 201 having “Z” is selected.

When the thumbnail 201 having “Z” is clicked in the selected state shownin FIG. 44, the display program 54F displays an image corresponding tothe thumbnail 201 having “Z” shown in FIG. 45.

Namely, when the data corresponding to the thumbnail 201 having “Z” area still image, the display program 54F displays it in its original size.When the data corresponding to the thumbnail 201 having “Z” are a movingimage, the display program 54F displays it in its original size andreproduces it. When the data corresponding to the thumbnail 201 having“Z” are a voice, the display program 54F displays the thumbnail 201 asenlarged to a predetermined size and reproduces the voice.

When an image corresponding to the thumbnail 201 having “Z” shown inFIG. 45 is clicked, the display program 54F returns to the state inwhich the thumbnail 201 having “Z” shown in FIG. 45 is selected.

FIGS. 46 through 48 illustrate the selection and enlarged display ofthumbnails 201 in the square view. When a thumbnail 201 having “B” isclicked with a thumbnail 201 having “M” selected as shown in FIG. 46,the display program 54F moves all thumbnails 201 displayed on the screensuch that the thumbnail 201 having “B” moves to the center of the screenas shown in FIG. 47. Then, the display program 54F enters the state inwhich the thumbnail 201 having “B” is selected.

When the thumbnail 201 having “B” is clicked in the selected state shownin FIG. 47, the display program 54F displays an image corresponding tothe thumbnail 201 having “B” shown in FIG. 48.

Namely, when the data corresponding to the thumbnail 201 having “B” area still image, the display program 54F displays it in its original size.When the data corresponding to the thumbnail 201 having “B” are a movingimage, the display program 54F displays it in its original size andreproduces it. When the data corresponding to the thumbnail 201 having“B” are a voice, the display program 54F displays the thumbnail 201 asenlarged to a predetermined size and reproduces the voice.

When an image corresponding to the thumbnail 201 having “B” shown inFIG. 48 is clicked, the display program 54F returns to the state inwhich the thumbnail 201 having “B” shown in FIG. 48 is selected.

Consequently, when the thumbnail 201 is clicked, the display program 54Fselects the clicked thumbnail 201, displays it enlarged, or reproducesthe corresponding moving image, so that the user can easily and quicklyselect desired data to display or reproduce the data.

The following describes the status transitions from the state shown inFIG. 38 to the state shown in FIG. 39, from the state shown in FIG. 41to the state shown in FIG. 42, from the state shown in FIG. 44 to thestate shown in FIG. 45 or from the state shown in FIG. 47 to the stateshown in FIG. 48, and from the state shown in FIG. 39 to the state shownin FIG. 38, from the state shown in FIG. 42 to the state shown in FIG.41, from the state shown in FIG. 45 to the state shown in FIG. 44 orfrom the state shown in FIG. 48 to the state shown in FIG. 47.

The status transitions from the state shown in FIG. 38 to the stateshown in FIG. 39, from the state shown in FIG. 41 to the state shown inFIG. 42, from the state shown in FIG. 44 to the state shown in FIG. 45or from the state shown in FIG. 47 to the state shown in FIG. 48corresponds to a request by the user for displaying or reproducing adesired still image, a moving image, or a voice. Because an operation onthe thumbnail 201 is meant finally to display or reproduce a stillimage, a moving image, or a voice, these status transitions areimportant for the user as shown in FIG. 49.

On the contrary, the status transitions from the state shown in FIG. 39to the state shown in FIG. 38, from the state shown in FIG. 42 to thestate shown in FIG. 41, from the state shown in FIG. 45 to the stateshown in FIG. 44 or from the state shown in FIG. 48 to the state shownin FIG. 47 is a transition to a transient state meant to select forexample another thumbnail 201 in order to end the display orreproduction of a still image, a moving image, or a voice. Therefore,these status transitions are less important for the user as shown inFIG. 49.

When a status transition which is important for t he user is executed asshown in FIG. 50, for example, a desired still image, moving image, orvoice is displayed or reproduced for example, the display program 54Fchanges the display comparatively slowly in which the user can visuallyrecognize the change in display, thereby making the user surelyrecognize the display or reproduction of the specified image or voice.

On the other hand, when a status transition which is less important tothe user is executed, for example, the display or reproduction of adesired still image, moving image, or voice is stopped to change thedisplay to the selection of a thumbnail 201, the display program 54Fquickly changes the display.

Thus, the display program 54F makes the user surely recognize theimportant status transitions and comparatively quickly executes thestatus transitions which are less important for the user, therebysatisfying the contrary demands for the slow but easily recognizablestatus transitions and the quick, time-saving responses.

The following describes how a selected thumbnail 201 is displayed. Asshown in FIG. 51, when a thumbnail 201 is selected, the display program54F displays a frame 281 around the selected thumbnail. When anotherthumbnail 201 is selected, the display program 54F deletes the framefrom the deselected thumbnail 201.

The display program 54F varies the lightness, saturation or hue of aframe 281 in correspondence with the lapse of time. FIG. 52 shows oneexample of a change in the lightness or saturation of the frame 281.

For example, the display program 54F varies the lightness or saturationof 0% of the frame 281 linearly up to 100% in 0.5 second and thelightness or saturation of 100% of the frame 281 linearly to 0% in 0.5second, repeating this change.

The process of varying the lightness of the frame 281 requires lesscomputation than that of the process of varying saturation or hue.

FIG. 53 shows one example of varying the hue of the frame 281 incorrespondence with the lapse of time.

For example, the display program 54F varies the hue of the frame 281corresponding to 0 degree of hue circle linearly up to 360 degrees in 1second and returns the hue of the frame 281 which has reached 360degrees of hue circle to 0 degree, repeating this change.

Consequently, the display program 54F allows the user surely recognize aselected thumbnail 201 displayed on the screen containing thumbnailshaving various lightnesses, colors, and hues. The period of thevariation of the lightness, saturation, and hue of the frame 281 is notlimited to 1 second; for example, the period may be set to any timebetween 0.1 second and 10 second for example as long as it isrecognizable by the user.

FIG. 54 illustrates the attributes for example of the data correspondingto the selected thumbnail 201. When a thumbnail 201 is selected, thedisplay program 54F displays a frame 281 and, if a predetermined timehas passed with the touch pad 6 for example not operated, displays, onan additional attribute display 291, such attributes as file name, datatitle, data size, and reproduction time of the file of the datacorresponding to the thumbnail 201.

When the thumbnail 201 is not selected, the display program 54F deletesthe frame 281 and the additional attribute display 291 of that thumbnail201.

For example, as shown in FIG. 55, if 1 second has passed after theselection of the thumbnail 201, the display program 54F displays on theadditional attribute display 291 the file name, icon indicative of stillor moving image, data size, and date. In the example shown in FIG. 55,the additional attribute display 291 has a transparent frame and atransparent background in order to allow the user to visually recognizeother not selected thumbnails 201.

The following describes a full screen display mode for displaying a fullscreen on the LCD 7. After startup, the display program 54F displaysthumbnails 201 and others in a predetermined range in the display areaof the LCD 7.

When a predetermined icon or a predetermined key of the keyboard 5 isoperated, the display program 54F displays thumbnails 201 and others inall display area of the screen of the LCD 7 as shown in FIG. 57. Withthe entire display area of the screen of the LCD 7 displayed with imagesby the display program 54F, the personal computer 1 accepts an operationof the jog dial 4, the touch pad 6, or the keyboard 5 as an input madeto the display program, except for the combined operations of specifickeys.

When the thumbnails 201 and others are displayed in the predeterminedrange of the display area of the screen on the LCD 7, operating an icon301 shown in FIG. 58 causes the display program 54F to display thethumbnails 201 and others in all of the display area of the screen onthe LCD 7. When the thumbnails 201 and others are displayed in all ofthe display area of the screen on the LCD 7, operating the icon 301shown in FIG. 58 causes the display program 54F to display thethumbnails 201 and others in a predetermined range of the display areaof the screen on the LCD 7.

When the thumbnails 201 and others are displayed in all of the displayarea of the screen on the LCD 7, clicking an icon 311 shown in FIG. 59causes the display program 54F to display the thumbnails 201 and othersin a predetermined range of the display area of the screen on the LCD 7and start another application program corresponding to the icon 311.

Thus, when the user operates the icon 301 or a predetermined key of thekeyboard 5, the display program 54F can display thumbnails 201 andothers in all of the display area of the screen on the LCD 7. Whenthumbnails 201 and others are displayed in all of the display area ofthe screen on the LCD 7, the display program 54F can directly startupanother application program in response to the operation of the icon311. Displaying thumbnails 201 and others on all of the screen of theLCD 7 can prevent such erroneous operations by the user as operatingother application programs for example.

If the application program corresponding to the icon 311 has beenstarted up, the user is wanting to link the display program 54F with theapplication program in many cases, so that the display program 54Fautomatically displays thumbnails 201 and others in a predeterminedrange of the display area of the screen on the LCD 7. Consequently, theuser can efficiently manipulate the display program 54F and theapplication program.

The following describes the processing of the display program 54F andthe reading program 54G to be executed by the CPU 51.

FIG. 60 is a flowchart describing the content reading processing to beexecuted by the display program 54F and the reading program 54G. In stepS11, the reading program 54G reads the number of content items stored inthe memory stick 116, via the memory stick interface 114. The readingprogram 54G supplies the number of content items stored in the memorystick 116 to the display program 54F.

In step S12, the reading program 54G sequentially reads the items ofcontent from the memory stick 116 via the memory stick interface 114 andsupplies the read items of content to the display program 54F. Thecontent reading process by the reading program 54G from the memory stick116 is executed concurrently with the following processing.

In step S13, the processing manager 151 of the display program 54Fobtains the number of content items read by the reading program 54G onthe basis of the data supplied from the reading program 54G. In stepS14, the processing manager 151 of the display program 54F specifies thefirst item of content read by the reading program 54G.

In step S15, the processing manager 151 of the display program 54Fcomputes a position at which the thumbnail 201 corresponding to thecontent is displayed. In step S16, the content processing routine 152 ofthe display program 54F generates a thumbnail 201 for the read content.In step S17, the content processing routine 152 of the display program54F displays the thumbnail 201 at the position computed by theprocessing manager 151. If the position at which the thumbnail 201 is tobe displayed is outside the display area of the LCD 7, the contentprocessing routine 152 does not display the thumbnail 201.

In step S18, the display program 54F checks whether all thumbnails forall items of content which have been read are generated or not. If allthe thumbnails 201 corresponding to all items of content are notgenerated, then the procedure goes to step S19, in which the processingmanager 151 of the display program 54F specifies the next item ofcontent read by the reading program 54F.

In step S20, the processing manager 151 of the display program 54Fobtains the number of content items read by the reading program 54G onthe basis of the data supplied from the reading program 54G and then theprocedure returns to step S15 to repeat the abovementioned processing ofgenerating thumbnails 201.

If, in step S18, all thumbnails 201 corresponding to all items ofcontent read have been generated, then the procedure goes to step S21,in which the display program 54F determines whether all content itemsstored in the memory stick 116 have been read. If all content itemsstored in the memory stick 116 have not been read, then the procedurereturns to step S12 to repeat the content reading process.

If, in step S21, all content items stored in the memory stick 116 havebeen read, then the thumbnails 201 corresponding to these content itemsare generated, upon which the generation process comes to an end.

Thus, the display program 54F and the reading program 54G cansequentially read the content items from the memory stick 116 andgenerates the thumbnails 201 corresponding to these content items,displaying the generated thumbnails 201 on the LCD 7.

The following describes the voice data display processing to be executedby the display program 54F, with reference to the flowchart shown inFIG. 61. In step S31, the display program 54F divides the thumbnail 201having a predetermined size into a predetermined number of areas inaccordance with the size of voice data. If the voice data is large, thedisplay program 54F increases the number of divisions of the thumbnail201; if the voice data is small, the display program 54F decreases thenumber of divisions of the voice data.

In step S32, the display program 54F extracts the data of apredetermined length corresponding to the division number (the number ofareas) of the thumbnail 201 from the voice data. In step S33, thedisplay program 54F converts the extracted data into RGB data (thenumber of pieces of the RGB data which is equal to the number of areas)by the processing described with reference to FIG. 11. In step S34, thedisplay program 54F sets, one to one, the resultant RGB data pieces tothe thumbnail 201 areas generated by the division.

In step S35, the display program 54F performs a blur operation (a blurprocess) on the thumbnail 201. In step S36, the display program 54Fwrites text indicative of voice data attributes for example at apredetermined position in the thumbnail 201, upon which the processingcomes to an end.

Thus, the display program 54F can create the thumbnail 201 of the voicedata in correspondence with its size. In the same manner, the displayprogram 54F creates a thumbnail 201 corresponding to text data forexample.

The following describes the line view display processing to be executedby the display program 54F, with reference to the flowchart shown inFIG. 62. In step S51, the display program 54F determines the number ofaxes 221. For example, when displaying only the thumbnail 201, thedisplay program 54F uses only 1 axis 221; when displaying a thumbnail201 and the text 211, the display program 54F uses 2 axes 221.

In step S52, the display program 54F determines the orientation of theaxis 221 from the equation (1) or (2). In step S53, the display program54F determines a display position of the thumbnail 201 on the basis ofthe axis 221.

In step S54, the display program 54F determines whether to display thetext 211 corresponding to the content. If the text 211 corresponding tothe content is to be displayed, then, in step S55, the display program54F determines the arrangement of the text 211 on the basis of the axis221. In step S56, the display program 54F displays the text 211 at theposition defined by the process of step S55 and then the procedure goesto step S57.

If, in step S54, the text 211 corresponding to the content is not bedisplayed, the process for displaying the text 211 is not required, sothat the processes in steps S55 and S56 are skipped, the procedure goingto step S57.

In step S57, the display program 54F displays the thumbnail 201 at theposition defined by the process of step S53 and the procedure returns tostep S52 to repeat the display processing.

Thus, the display program 54F displays the thumbnail 201 and the text211 on the basis of the open axes 221 such as line or curve.

The following describes the loop view display processing to be executedby the display program 54F, with reference to the flowchart shown inFIG. 63. In step S71, the display program 54F determines the number ofaxes 241. For example, when displaying only a thumbnail 201, the numberof axes 241 is set to 1; when displaying a thumbnail 201 and a text 211,the number of axes 241 is set to 2.

In step S72, the display program 54F determines the shape of the axis241. In step S73, the display program 54F determines the displayposition of the thumbnail 201 from equation (6) on the basis of the axis241, for example.

In step S74, the display program 54F determines whether to display atext 211 corresponding to the content. If the text 211 corresponding tothe content is to be displayed, the procedure goes to step S75, in whichthe arrangement of the text 211 is defined on the basis of the axis 241.In step S76, the display program 54F displays the text 211 at theposition defined by the process of step S75 and the procedure goes tostep S77.

If, in step S74, the text 211 corresponding to the content is not to bedisplayed, the process of displaying the text 211 is not required, sothat the processes of steps S75 and S76 are skipped and the proceduregoes to step S77.

In step S77, the display program 54F displays the thumbnail 201 at theposition defined by the process of step S73 and the procedure returns tostep S73 to repeat the display processing.

Thus, the display program 54F displays the thumbnail 201 and the text211 on the basis of the axes 221 in an enclosed shape such as a circleor an ellipse.

The following describes the spiral view display processing to beexecuted by the display program 54F, with reference to the flowchartshown in FIG. 64. In step S91, the display program 54F determines thenumber of axes 261. For example, when displaying only a thumbnail 201,the number of axes 261 is set to 1; when displaying a thumbnail 201 anda text 211, the number of axes 261 is set to 2.

In step S92, the display program 54F determines whether the jog dial 4,the keyboard 5, or the touch pad 6 has been operated to select athumbnail 201. If the selection of a thumbnail 201 has not been made,the procedure goes to step S93, in which the display program 54F sets aspiral having large radius r, upon which the procedure goes to step S95.

If, in step S92, the selection of a thumbnail 201 has been made, thenthe procedure goes to step S94, in which the display program 54F sets aspiral having smaller radius r to the axis 261 in accordance with theselection frequency per unit time, upon which the procedure goes to stepS95.

In step S95, the display program 54F determines the display position ofthe thumbnail 201 from equations (11), (12), and (13) for example on thebasis of the axis 261.

In step S96, the display program 54F determines whether to display thetext 211 corresponding to a specific piece of content. If the text 211corresponding to the content is to be displayed, then the procedure goesto step S97 to determine the arrangement of the text 211 on the basis ofthe axis 261. In step S98, the display program 54F displays the text 211at the positioned defined by the process of step S97 and the proceduregoes to step S99.

If, in step S96, the text 211 corresponding to the content is not to bedisplayed, the process of displaying the text 211 is not required andtherefore the processes of steps S97 and S98 are skipped, the proceduregoing to step S99.

In step S99, the display program 54F displays the thumbnail 201 at theposition defined by the process of step S95, upon which the procedurereturns to step S92 to repeat the display processing.

Thus, the display program 54F displays the thumbnail 201 and the text211 on the basis of the axis 261 of the spiral. If the selection of thethumbnail 201 is found, the display program 54F displays the thumbnail201 and the text 211 on the basis of the axis 261 of the spiral havingsmall radius r.

The following describes the movement of an icon 202 to be executed bythe display program 54F, with reference to the flowchart shown in FIG.65. In step S111, the processing manager 151 of the display program 54Fdetermines which of the icons 202 has been clicked on the basis of theinput supplied from the touch pad 6. If none of the icons 202 has beenclicked, the procedure returns to step S111, in which the processingmanager 151 repeats the determination until one of the icons 202 isclicked.

If, in step S111, if one of the icons 202 is found clicked, then theprocedure goes to step S112, in which the processing manager 151 of thedisplay program 54F computes the final display position of the clickedicon 202.

In step S113, the processing manager 151 of the display program 54Fcomputes the display position of each icon 202 on the basis of the finaldisplay position obtained by the process of step S112 and an elapsedtime after the clicking. In step S114, the content processing routine152 of the display program 54F displays the icon 202 at the positionobtained by the process of step S113.

The display processing of the icon 202 in step S114 is performed at aperiod set by the processing manager 151. The period of the displayprocessing of the icon 202 is appropriately selected so that the icon202 is displayed as if it is moving.

In step S115, the processing manager 151 of the display program 54Fdetermines whether each icon 202 has been displayed at the final displayposition. If each icon 202 has not been displayed at the final displayposition, the procedure returns to step S113 to repeat the icon displayprocessing.

If, in step S115, each icon 202 has been displayed at the final displayposition, the procedure returns to step S111 to repeat the processingfrom the determination of whether the icon 202 has been clicked or not.

Thus, the display program 54F can display the movement of the icon 202at a predetermined speed when it is clicked.

The following describes the after-image display processing to beexecuted by the display program 54F, with reference to the flowchartshown in FIG. 66. In step S131, the display program 54F draws an alreadydrawn image by reducing its lightness (for example, to 80%).

In step S132, the display program 54F draws a new image over the imageprocessed in step S131 and then the procedure returns to steps S131 torepeat the draw processing.

Thus, the display program 54F draws a new image over the precedingimage, with gradually reducing lightness of the preceding image, so thatthe after-image can be displayed with ease.

The following describes the status transition processing to be executedby the display program 54F, with reference to the flowchart shown inFIG. 67. In step S151, the display program 54F records the originalstate such as the current display position of a thumbnail 201 or an icon202 from which transition takes place. In step S152, the display program54F determines such a state of the destination of the transition as thedisplay position of the thumbnail 201 or the icon 202.

In step S153, the display program 54F obtains the importance oftransition. For example, the importance of transition is determined foreach specific transition and the determined importance is stored in thedisplay program 54F. In step S154, the display program 54F determines atransition function on the basis of the importance of transition. Forexample, when the transition is much important, the display program 54Fselects a transition function which slows the status transition; whenthe transition is less important, the display program 54F selects atransition function which speeds up the status transition.

In step S155, the display program 54F computes a next state incorrespondence with an elapsed time on the basis of the selectedtransition function. In step S156, the display program 54F moves to thestate obtained in step S155. For example, the display program 54Fcomputes the position of the thumbnail 201 or the icon 202 correspondingto the elapsed time in step S155 and displays the thumbnail 201 or theicon 202 at the obtained position in step S156.

In step S157, the display program 54F determines whether to change thestate to which the transition is made, on the basis of a signal from thejog dial 4, the touch pad 6, or the keyboard 5. If the destination stateis not to be changed, the procedure goes to step S158.

If, in step S157, the destination state is to be changed, then theprocedure goes to step S159, in which the current state is set to theinitial state before the transition. In step S160, the display program54F determines such a destination state as the display position of thethumbnail 201 or the icon 202.

In step S161, the display program 54F obtains a new transitionimportance. In step S162, the display program 54F determines atransition function on the basis of the new transition importance.

In step S158, the display program 54F compares the current state withthe destination state to determine whether the destination state hasbeen reached or not. If the destination state has not been reached, theprocedure returns to step S155 to repeat the processing from thecomputation of a next state.

If, in step S158, the destination state has been reached, the statustransition processing comes to an end.

Thus, the display program 54F changes display states for example on thebasis of transition functions and, if a request comes midway during atransition, moves from that state to the requested state. As described,the display program 54F selects a transition function on the basis ofthe importance of transition, so that, for a much important transition,it takes place comparatively slowly to enable the user to surelyrecognize the transition and, for a less important transition, it takesquickly.

The following describes the enlarged display processing to be executedby the display program 54F, with reference to the flowchart shown inFIG. 68. In step S181, the display program 54F determines, on the basisof a signal supplied from the touch pad 6, whether a thumbnail 201 hasbeen clicked or not. If a thumbnail 201 is found not clicked, theprocedure returns to step S181 to repeat the determination.

If, in step S181, a thumbnail 201 is found clicked, then the proceduregoes to step S182, in which the display program 54F determines whetherthe clicked thumbnail 201 is at the center of the window.

If, in step S182, the clicked thumbnail 201 is not at the center of thewindow, then the procedure goes to step S183, in which the displayprogram 54F changes the display so that the clicked thumbnail 201 comesto the center of the window, upon which the procedure returns to stepS181 to repeat the above-mentioned processing.

If, in step S182, the clicked thumbnail 201 is found at the center ofthe window, then the procedure goes to step S184, in which the displayprogram 54F displays the clicked thumbnail 201 in the enlarged mode (ifthe thumbnail 201 corresponds to still image data, the thumbnail isdisplayed with its original size, if the thumbnail 201 corresponds tomoving image data, a moving image is generated, and if the thumbnail 201corresponds to voice data, a voice is reproduced), then the procedurereturns to step S181 to repeat the above-mentioned processing.

Thus, when a thumbnail 201 is clicked, the display program 54F displaysthe clicked thumbnail 201 at the center or in the enlarged mode, so thatthe user can quickly know the thumbnail 201 and the contents of the datacorresponding to the thumbnail 201 with a simple operation.

The following describes the processing of displaying a frame 281 to beexecuted by the content processing routine 152 of the display program54F, with reference to the flowchart shown in FIG. 69. In step S201, thecontent processing routine 152 determines whether the thumbnail 201displayed by the content processing routine 152 is selected or not. Ifthe thumbnail 201 displayed by the content processing routine 152 isfound not selected, the procedure returns to step S201 to repeat thedetermination until that thumbnail 201 displayed is selected.

If, in step S201, that thumbnail 201 is found selected, then theprocedure goes to step S202, in which the content processing routine 152starts counting an elapsed time. The elapsed time counting is continuedin the following processing.

In step S203, the content processing routine 152 determines a lightnessvariation function as shown in the example of FIG. 52 for example. Instep S204, the content processing routine 152 computes the lightness ofthe frame 281 on the basis of the elapsed time. In step S205, thecontent processing routine 152 displays the frame 281 having thelightness computed in step S204.

In step S206, the content processing routine 152 determines whether thethumbnail 201 displayed by the content processing routine 152 isselected or not. If the thumbnail 201 shown by the content processingroutine 152 is found selected, the procedure goes to step S204 to repeatthe processing of displaying the frame 281.

If, in step S206, the thumbnail 201 displayed by the content processingroutine 152 is found not selected, then the procedure goes to step S207,in which the content processing routine 152 deletes the frame 281. Thenthe procedure returns to step S201 to repeat the processing ofdisplaying the frame 281.

Thus, the display program 54F can display the frame 281 with itslightness periodically varied onto the selected thumbnail 201. In thelike processing, the display program 54F can display the frame 281 withits saturation or hue periodically varied onto the selected thumbnail201.

The following describes the processing of displaying an additionalattribute display 291 to be executed by the content processing routine152 of the display program 54F, with reference to the flowchart shown inFIG. 70. In step S221, the display program 54F determines, on the basisof a signal coming from the jog dial 4, the touch pad 6, or the keyboard5 whether a display change command has been inputted or not. If thedisplay change command is not found inputted, the procedure goes to stepS222, in which the content processing routine 152 determines whether thethumbnail displayed by the content processing routine 152 is selected ornot.

If, in step S222, the thumbnail 201 shown by the content processingroutine 152 is found selected, then the procedure goes to step S223, inwhich the content processing routine 152 determines whether apredetermined time (for example, 1 second) has passed since theselection of the thumbnail 201.

If, in step S223, the predetermined time is found passed, then theprocedure goes to step S224, the content processing routine 152 displaysthe additional attribute display 291 having a semitransparent frame andbackground including corresponding text onto the thumbnail 201, uponwhich the procedure returns to step S221 to repeat the above-mentionedprocessing.

If, in step S221, a display change command is found inputted, itindicates that a process such as movement of the thumbnail 201 has beenexecuted, so that the procedure goes to step S225, in which the contentprocessing routine 152 deletes the additional attribute display 291corresponding to the thumbnail 201, upon which the procedure returns tostep S221 to repeat the above-mentioned processing.

If, in step S222, the thumbnail 201 displayed by the content processingroutine 152 is not found selected, it indicates that the additionalattribute display 291 need not be displayed. The procedure goes to stepS225, in which the content processing routine 152 deletes the additionalattribute display 291 corresponding to the thumbnail 201, upon which theprocedure returns to step S221 to repeat the above-mentioned processing.

If, in step S223, the predetermined time is found not passed, then theprocedure goes to step S225, in which the content processing routine 152deletes the additional attribute display 291 corresponding to thethumbnail 201, upon which the procedure returns to step S221 to repeatthe same processing.

Thus, after the selection of the thumbnail 201 and the passing of apredetermined time, the display program 54F displays the additionalattribute display 291 corresponding to the selected thumbnail 201,thereby enabling high-speed display variation without intervening anoperation by the user.

Because the frame and background of the additional attribute display 291to be displayed by the display program 54F are semitransparent, the usercan check the thumbnails 201 and others arranged under (in the depth ofscreen) the additional attribute display 291.

The following describes the processing of selecting a first display modefor displaying thumbnails 201 and others in a predetermined area of thedisplay screen on the LCD 7 and a second display mode for displayingthumbnails 201 and others all over the display screen of the LCD 7,which are executed by the display program 54F, with reference to theflowchart shown in FIG. 71. In step S251, the display program 54F setsthe first display mode (displaying a thumbnail 201 and others in apredetermined area on the display screen on the LCD 7) for displayingthe frame of a predetermined area.

In step S252, the display program 54F determines whether anotherapplication program has been started. If another application is foundstarted, the first display mode is selected and therefore the procedurereturns to step S252 without changing the display mode, repeating theabove-mentioned processing.

If, in step S252, another application program is found not started, thenthe procedure goes to step S253, in which the display program 54Fdetermines, on the basis of a signal supplied from the jog dial 4, thetouch pad 6, or the keyboard 5, whether a display mode change commandhas been inputted or not.

If, in step S253, a display mode change command is not found inputted,it indicates that the display mode need not be changed, so that theprocedure returns to step S252 to repeat the above-mentioned processing.

If, in step S253, a display mode change command is found inputted, thenthe procedure goes to step S254, in which the display program 54F setsthe second display mode which displays thumbnails 201 and others allover the display screen of the LCD 7.

In step S255, the display program 54F determines whether anotherapplication program has been started or not. If another applicationprogram is found not started, then the procedure goes to step S256 todetermine, on the basis of a signal supplied from the jog dial 4, thetouch pad 6, or the keyboard 5, whether a display mode change commandhas been inputted or not.

If, in step S256, a display mode change command is not found inputted,it indicates that the display mode need not be changed, so that theprocedure returns to step S255 to repeat the determination process.

If, in step S256, a display mode change command is found inputted, thenthe procedure returns to step S251, in which the display program 54Fsets the first display mode to repeat the above-mentioned processing.

If, in step S255, another application program is found started, itindicates that the first display mode is to be set, so that theprocedure returns to step S251, in which the display program 54F setsthe first display mode to repeat the processing.

Thus, the display program 54F switches between the first and seconddisplay modes in accordance with the inputted display mode changecommand and, when another application program is started, changes thedisplay mode to the first display mode.

The above-mentioned sequence of processes can be executed by hardware orsoftware. If the sequence of processes is executed by software, theprograms constituting the software are installed from a program storagemedium, to a computer which is embedded in a dedicated hardware devicebeforehand or a computer, such as a general-purpose personal computer,capable of executing various capabilities in which various programs areinstalled.

The program storage medium, which is installed in a computer, forstoring computer-readable and executable programs may be a packagemedium constituted by the magnetic disk 121 (including floppy disk), theoptical disc 122 (including CD-ROM (Compact Disc-Read Only Memory) andDVD (Digital Versatile Disc)), the magneto-optical disk 123 (includingMD (Mini Disk)), or the semiconductor memory 124, or the ROM or the HDD67 on which the programs are stored temporarily or permanently as shownin FIG. 5. Programs are stored in the program storage medium from wiredor wireless communications media such as a local area network, theInternet, and digital satellite broadcasting through the interface suchas a router and the modem 75 as required.

It should be noted that the steps describing the programs to be storedin the program storage medium are not only executed in a time-seriesmanner in the order described, but also in parallel or in a discretemanner.

It should also be noted that the system as used herein denotes an entireapparatus constituted by a plurality of component units.

In the above described method, apparatus, medium, and program of thepresent invention, a thumb-nail area is divided in accordance withparticular data, the number of pixel value equal to the number ofdivided areas is created, the created pixels values are set to thedivided thumbnails, and the thumbnail with the pixel values set isdisplayed. Consequently, by displaying thumbnails corresponding to datanot including images, both the data including and not including imagescan be handled collectively.

While the embodiments of the present invention have been described usingspecific terms, such description is for illustrative purposes only, andit is to be understood that changes and variations may be made withoutdeparting from the spirit or scope of the following claims.

1. A display method, comprising the steps of: dividing a specificdisplay area of a display apparatus into a plurality of areas as afunction of a size of desired non-image data; generating image data thatis related to the desired non-image data and comprises the plurality ofareas divided, by setting a pixel data for each of the plurality ofareas based on the non-image data; and displaying the image generated;wherein a number of the plurality of areas within the generated imagedata are proportional to the size of said non-image data so as toincrease the number of the plurality of areas the display area isdivided into when the size of the said non-image data is larger and todecrease the number of the plurality of areas the display area isdivided into when the size of the said non-image data is smaller, andwherein each pixel of the generated image is related to a specificcharacter of the non-image data.
 2. A displaying method according toclaim 1, wherein a lightness or saturation of one or a plurality ofpixels in each of said areas is modified by obtaining unit dataquantities of said non-image data as data values of red, green and bluedots of said one or a plurality of pixels in each of said areas.
 3. Adisplaying method according to claim 1, wherein boundaries between theplurality of areas are blurred after a lightness or saturation of one ora plurality of pixels in each of said areas is changed.
 4. The displaymethod according to claim 1, wherein a size of an area of said pluralityof areas is smaller than an area corresponding to a thumbnail image. 5.A display method, comprising the steps of: dividing a specific displayof a display apparatus area into a plurality of areas as a function of asize of desired non-image data; generating image data that is related tothe desired non-image data and comprises the plurality of areas divided,by setting a pixel data for each of the plurality of areas based on thenon-image data; and displaying the image generated, wherein a number ofplurality of areas within the generated image data are proportional tothe size of said non-image data so as to increase the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is larger and to decrease the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is smaller, and wherein each pixel of the generatedimage is related to a specific character of the non-image data.
 6. Adisplay method, comprising the steps of: dividing a specific display ofa display apparatus area into a plurality of areas as a function of asize of desired non-image data; generating image data that is related tothe desired non-image data and comprises the plurality of areas divided,by setting a pixel data for each of the plurality of areas based on thenon-image data; and displaying the image generated, wherein saidnon-image data is a text file, and wherein at least a part of thecontents of said text file is displayed in a form of text in such amanner as to be overlapped to image information, wherein a number ofplurality of areas within the generated image data are proportional tothe size of said non-image data so as to increase the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is larger and to decrease the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is smaller, and wherein each pixel of the generatedimage is related to a specific character of the non-image data.
 7. Adisplaying apparatus, comprising: means for dividing a specific displayarea of a display apparatus into a plurality of areas as a function of asize of desired non-image data; means for generating image data that isrelated to the desired non-image data and comprises the plurality ofareas divided, by setting pixel data for each of the plurality of areasbased on the non-image data; means for displaying the image generated,wherein a number of plurality of areas within the generated image dataare proportional to the size of said non-image data so as to increasethe number of the plurality of areas the display area is divided intowhen the size of the said non-image data is larger and to decrease thenumber of the plurality of areas the display area is divided into whenthe size of the said non-image data is smaller, and wherein each pixelof the generated image is related to a specific character of thenon-image data.
 8. A displaying apparatus according to claim 7, whereina lightness or saturation of one or a plurality of pixels in each ofsaid areas is modified by obtaining unit data quantities of saidnon-image data as data values of red, green and blue dots of said one ora plurality of pixels in each of said areas.
 9. A displaying apparatusaccording to claim 7, wherein boundaries among said areas are blurredafter a lightness or saturation of one or a plurality of pixels in eachof said areas is changed.
 10. A displaying apparatus, comprising: meansfor dividing a specific display area of a display apparatus into aplurality of areas as a function of a size of desired non-image data;means for generating image data that is related to the desired non-imagedata and comprises the plurality of areas divided, by setting a pixeldata for each of the plurality of areas based on the non-image data;means for displaying the image generated, wherein a number of pluralityof area is a function of a size said non-image data, and wherein anumber of plurality of areas within the generated image data areproportional to the size of said non-image data so as to increase thenumber of the plurality of areas the display area is divided into whenthe size of the said non-image data is larger and to decrease the numberof the plurality of areas the display area is divided into when the sizeof the said non-image data is smaller, and wherein each pixel of thegenerated image is related to a specific character of the non-imagedata.
 11. A displaying apparatus, comprising: means for dividing aspecific display area of a display apparatus into a plurality of areasas a function of a size of desired non-image data; means for generatingimage data that is related to the desired non-image data and comprisesthe plurality of areas divided, by setting a pixel data for each of theplurality of areas based on the non-image data; and means for displayingthe image generated, wherein said non-image data is a text file, whereinat least a part of the contents of said text file is displayed in a formof text in such a manner as to be overlapped to image information, andwherein a number of plurality of areas within the generated image dataare proportional to the size of said non-image data so as to increasethe number of the plurality of areas the display area is divided intowhen the size of the said non-image data is larger and to decrease thenumber of the plurality of areas the display area is divided into whenthe size of the said non-image data is smaller, and wherein each pixelof the generated image is related to a specific character of thenon-image data.
 12. A computer-readable medium for storing a program,said program comprising the steps of: dividing a specific display areaof a display apparatus into a plurality of areas as a function of a sizeof desired non-image data; generating image data that is related to thedesired non-image data and comprises the plurality of areas divided, bysetting a pixel data for each of the plurality of areas based on thenon-image data; and displaying the image generated; wherein a number ofplurality of areas within the generated image data are proportional tothe size of said non-image data so as to increase the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is larger and to decrease the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is smaller, and wherein each pixel of the generatedimage is related to a specific character of the non-image data.
 13. Theprogram according to claim 12, wherein a lightness or saturation of oneor a plurality of pixels in each of said areas is modified by obtainingunit data quantities of said non-image data as data values of red, greenand blue dots of said one or a plurality of pixels in each of saidareas.
 14. The program according to claim 12, wherein boundaries betweenthe plurality of areas are blurred after a lightness or saturation ofone or a plurality of pixels in each of said areas is changed.
 15. Acomputer-readable medium for storing a program, said program comprisingthe steps of: dividing a specific display area of a display apparatusinto a plurality of areas as a function of a size of desired non-imagedata; generating image data that is related to the desired non-imagedata and comprises the plurality of areas divided, by setting a pixeldata for each of the plurality of areas based on the non-image data; anddisplaying the image generated, wherein the pixel data is proportionalto a size of the non-image data, wherein a number of plurality of areasis a function of a size of said non-image data, and wherein a number ofplurality of areas within the generated image data are proportional tothe size of said non-image data so as to increase the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is larger and to decrease the number of theplurality of areas the display area is divided into when the size of thesaid non-image data is smaller, and wherein each pixel of the generatedimage is related to a specific character of the non-image data.
 16. Acomputer-readable medium for storing a program, said program comprisingthe steps of: dividing a specific display area of a display apparatusinto a plurality of areas as a function of a size of desired non-imagedata; generating image data that is related to the desired non-imagedata and comprises the plurality of areas divided, by setting a pixeldata for each of the plurality of areas based on the non-image data; anddisplaying the image generated, wherein said non-image data is a textfile, wherein at least part of the contents of said text file isdisplayed in a form of text in such a manner as to be overlapped toimage information, and wherein a number of plurality of areas within thegenerated image data are proportional to the size of said non-image dataso as to increase the number of the plurality of areas the display areais divided into when the size of the said non-image data is larger andto decrease the number of the plurality of areas the display area isdivided into when the size of the said non-image data is smaller, andwherein each pixel of the generated image is related to a specificcharacter of the non-image data.
 17. A computer readable medium adaptedto store a program, the program, comprising the steps of: dividing saidspecific display area into a plurality of areas as a function of a sizeof desired non-image data; generating image data that is related to thedesired non-image data and comprises the plurality of areas divided, bysetting a pixel data for each of the plurality of areas based on thenon-image data; and displaying the image generated, wherein the pixeldata is proportional to a size of the non-image data, and wherein anumber of plurality of areas within the generated image data areproportional to the size of said non-image data so as to increase thenumber of the plurality of the display area is divided into when thesize of the said non-image data is larger and to decrease the number ofthe plurality of areas the display area is divided into when the size ofthe said non-image data is smaller, and wherein each pixel of thegenerated image is related to a specific character of the non-imagedata.
 18. The program according to claim 17, wherein a lightness orsaturation of one or a plurality of pixels in each of plurality of areasis modified by obtaining unit data quantities of said non-image data asdata values of red, green and blue dots of said one or a plurality ofpixels in each of said areas.
 19. The program according to claim 17,wherein boundaries between the plurality of areas are blurred after alightness or saturation of one or a plurality of pixels in each of saidareas is changed.
 20. A computer readable medium adapted to store aprogram, the program, comprising the steps of: dividing a specificdisplay area of a display apparatus into a plurality of areas as afunction of a size of desired non-image data; generating image data thatis related to the desired non-image data and comprises the plurality ofareas divided, by setting a pixel data for each of the plurality ofareas based on the non-image data; and displaying the image generated,wherein the pixel data is proportional to a size of the non-image data,wherein a number of plurality of areas is a function of a size of saidnon-image data, and wherein a number of plurality of areas within thegenerated image data are proportional to the size of said non-image dataso as to increase the number of the plurality of areas the display areais divided into when the size of the said non-image data is larger andto decrease the number of the plurality of areas the display area isdivided into when the size of the said non-image data is smaller, andwherein each pixel of the generated image is related to a specificcharacter of the non-image data.
 21. A computer readable medium adaptedto store a program, the program, comprising the steps of: dividing aspecific display area of a display apparatus into a plurality of areasas a function of a size of desired non-image data; generating image datathat is related to the desired non-image data and comprises theplurality of areas divided, by setting a pixel data for each of theplurality of areas based on the non-image data; and displaying the imagegenerated, wherein the pixel data is proportional to a size of thenon-image data, wherein said non-image data is a text file, wherein atleast part of the contents of said text file is displayed in the form oftext in such a manner as to be overlapped to said image information, andwherein a number of plurality of areas within the generated image dataare proportional to the size of said non-image data so as to increasethe number of the plurality of areas the display area is divided intowhen the size of the said non-image data is larger and to decrease thenumber of the plurality of areas the display area is divided into whenthe size of the said non-image data is smaller, and wherein each pixelof the generated image is related to a specific character of thenon-image data.